Stereoscopic display

ABSTRACT

A stereoscopic display method or system includes an image display panel, object tracking sensors, and a means to create first or left, and second or right stereoscopic images based upon viewpoint location. This allows the user to perceive the viewed 3D stereoscopic image as approximately fixed in space. A first embodiment employs differently filtered colored, stereoscopic images. The first and second differently filtered colored images may be perceived as a 3D stereoscopic image by applying anaglyph glasses. In a second embodiment the method of passively polarized glasses may be applied with the result being a stereoscopic image whose location is approximately fixed in space. A third embodiment employs passively polarized anaglyph glasses. This provides the advantage of allowing two different viewers to see different virtual 3D stereoscopic images whose location remains approximately fixed in space. By employing tracking sensors, user gesturing or pointing may now allow interaction with the virtual 3D stereoscopic images in much the same way 2D objects are manipulated by employing a touch screen. This may be combined with voice commands. This allows for input systems such as virtual 3D touch panels, keyboards and remote controllers. In addition virtual 3D objects may be pushed, pulled rotated or manipulated in almost any way a real 3D object would be. The methods described may be applied in other ways, including, but not limited to gaming systems, 3D virtual caves, and simulators. It may also be used wired or wirelessly to remotely control or interact with other devices.

This patent application is a continuation of U.S. patent applicationSer. No. 14/547,555, issued as U.S. Pat. No. 9,883,173, filed on 19 Nov.2014, which claims the benefit of U.S. Provisional Patent ApplicationSer. No. 62/035,477, filed on 10 Aug. 2014, the benefit of U.S.Provisional Patent Application Ser. No. 61/934,806, filed on 2 Feb.2014, and the benefit of U.S. Provisional Patent Application Ser. No.61/920,755, filed on 25 Dec. 2013, the specifications of which arehereby incorporated herein by reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The instant invention relates to a stereo image display technique, bywhich a 3D image display may produce a stereoscopic image that takesviewpoint into account. By taking viewpoint into account, a stereoscopicimage may be created which appears to remain at approximately the samelocation in space as viewpoint changes.

Description of the Related Art

Methods of implementing a 3D stereoscopic image are described asfollows:

First of all, as mentioned in the following description, in order toimplement a 3D stereoscopic image, a first image for a left eye and asecond image for a right eye need to arrive at both eyes in a manner ofbeing discriminated from each other. For this, various methods areexplained as follows. These images shall be referred to as first or leftimage and second or right image.

Prior art displays which may be viewed as 3D images generally fall intofour methods for display of 3D imagery.

The first method employs polarized light images where the planes forfirst and second images are rotated by approximately 90 degrees. Asimilar method employs first and second circularly or ellipticallypolarized images. These polarized first and second images pass throughpolarized spectacles so that the corresponding image reaches the firstor left and second or right eye.

Another similar method employs liquid crystal shutter spectacles whichopen and close left and right shutters so as to allow the correspondingimage to reach the correct eye. Prior art employing liquid crystalshutters do not account for a change in viewing location from one viewerto the next. Therefore a 3D image would appear to be at differentlocations in space when viewed from differing viewpoints. Thus if oneviewer pointed at a 3D stereoscopic object, a viewer at a second viewinglocation would have difficulty determining what is being pointed at.

A third method employs a lenticular screen provided between a displayand both eyes. In particular, a propagating direction of light isrefracted via lens on the lenticular screen, whereby different imagesarrive at both eyes, respectively.

A fourth method requires no spectacles and utilizes parallax barriers sothat each eye sees the proper image. This technology shall be referredto as auto stereoscopic.

A final method employs differently colored filtered images, which areviewed through glasses whose lenses are colored differently. This methodor system shall be referred to as anaglyphic or an anaglyph.

BRIEF SUMMARY OF THE INVENTION

The instant invention employs a 3D stereoscopic method combined withposition tracking technology to produce a 3D stereoscopic image whichremains in approximately the same location in space even when viewedfrom various perspectives. This provides a 3D image which appears to bein approximately the same location despite the viewing location. Theviewer may move towards or away, up or down, left or right yet the imageremains in approximately the same location in space. It moves verylittle as the viewpoint changes. However, the 3D stereoscopic image willchange to reflect how the viewer would see the 3D objects in the imagefrom different perspectives. This 3D stereoscopic image that remainsapproximately fixed in spatial location may also be referred to as avirtually real image, virtual real image or virtual image. Positiontracking or position sensing shall be used interchangeably and mean thesame thing in this document.

The sensors on the display in combination with a computing device maydetect when an external object or pointer is in close proximity to thevirtual location of a 3D stereographic object whose position isstabilized in space. Thus stabilized, it becomes possible for viewers tointeract with the 3D stereoscopic image. Prior art employing gestures orvoice is limited in scope and does not allow the user to manipulate andinteract with a stereoscopic 3D virtual image. This shall be furtherelucidated in the description of the instant invention.

To accomplish this goal, the perspective position of the viewpoint mustbe sensed and measured. In this document position tracking and positionsensing shall be understood to mean the same thing. From thisinformation an image is created which is what an observer located atthis position would see if the real object were present. This viewpointis what one would expect to see if viewed in a monocular fashion (i.e.from one eye with the other closed). Therefore, for each viewinglocation (or eye location) a new image must be created. So the sensormust be able to calculate the position of each eye or lens of theviewer(s). The created images should take into account both the angularposition of the viewpoint and the distance. The viewing angle anddistance shall be referred to as viewing perspective, or viewpoint.

In the instant invention, the viewer is able to interact with thestabilized virtual image. This enables many applications. Input devicessuch as keyboards, remote controllers, musical instruments, virtualcaves, virtual simulators and interactive 3D gaming systems are a fewsuch applications, however the instant invention is not meant to belimited to these systems or devices. Some of these systems or deviceswill be further described in the following detailed description. Priorart that utilizes gestures to interact with a 2D image display arecommon. However these do not allow interaction with a 3D virtual image.

Prior art in exists which images are created based on viewpointperspective in real time 2D displays. Many video games at this timeemploy said technology. The image may be completely computer generatedor interpolated from photographic images taken from variousperspectives. This same technology may be adapted to createstereographic pairs of images, which when viewed by the stereographicmethods of the instant invention may produce the desired stabilized 3Dimage.

In addition, current motion picture creation employs sensors which tracklocation of body parts that are then used to create images. Such sensingtechnology could be used to track the eyes or lenses of glasses. Somelocation sensing methods employ small round objects that emit light,while others do not. These sensors may also be used to track thelocation of pointers, or body parts. They may also be used to trackwearable devices to include, but not be limited to gloves, glasses, andhats. By tracking these wearable objects or by tracking body parts theviewpoint may be calculated or inferred. Wearable devices mayor may notinclude objects or markers, which may emit or reflect light to thesensors. Pulses, frequency or other method to enable sensors todifferentiate location may code the emitted or reflected light. Thelight may be visible, infrared, or of other frequencies. Other positionsensing technologies that employ magnetism, accelerometers, orgravitation sensing may be employed to improve tracking of objects withthe intent of improvement of speed and accuracy.

Finally, the correct image must reach the correct lens or eye. One ofseveral methods is used to achieve this.

In the first embodiment anaglyph glasses are employed. The left or firstimage is color coordinated to pass through the left or first lens of theanaglyph glasses. The right or second image is color coordinated to passthrough the right or second lens of the anaglyph glasses. In this waythe viewer may see a 3D stereographic image.

In a second embodiment passively polarized glasses are employed. Theleft or first image has polarization coordinated to pass through theleft or first lens of the passively polarized glasses. The second orright image has polarization coordinated to pass through the right orsecond lens of the passively polarized glasses. In this way the viewermay see a 3D stereographic image. Another embodiment employs acombination of anaglyph and passively polarized glasses.

The instant invention may also display 3D stereographic images in themanner of prior art whereby the first and second image do not useinformation from the sensors to vary the image based on viewpointlocation. This method shall be referred to as prior art 3D. This methodmay be employed for viewing medium such as movies or games which havebeen created for prior art 3D.

Furthermore, the instant invention enables switching between 2D and 3Dmodes. In 2D mode multiple viewers may view multiple images. So two ormore viewers may use the display to watch different things.

Also, the display of the instant invention may be presented in portraitor landscape mode. The landscape or portrait mode may be manually orautomatically changed by means of an orientation sensor of varioustypes. So a tablet, phone, or other handheld device may use the displayof this invention.

To sum up the process, method, or system, of creating and viewing thevirtual image is as follows:

-   -   1. A left or first viewing perspective is sensed and location        quantified in space.    -   2. A left or first image is created corresponding to what would        be seen by a viewer with said left or first perspective.    -   3. The left or first image is displayed in conjunction with        technology, which limits the viewing to the left or first        perspective. This may be accomplished via anaglyph glasses,        passively polarized, or a combination of anaglyph and passively        polarized glasses.    -   4. A right or second viewing perspective is sensed and location        quantified in space.    -   5. A right or second image is created corresponding to what        would be seen by a viewer with said right or second perspective.    -   6. The right or second image is displayed in conjunction with        technology, which limits the viewing to the right or second        perspective. This may be accomplished via anaglyph glasses,        passively polarized glasses, or a combination of anaglyph and        passively polarized glasses.    -   7. The process is repeated for each viewer in sequence in a        continuous loop. However, the sequence may vary in order so long        as the image is coordinated with the stereoscopic method so that        the correct image reaches the intended eye.

In this manner a 3D stereoscopic image may be seen whose locationremains approximately fixed in space when viewed from differentperspectives. The display may be a liquid crystal display device, anelectroluminescent display device, an organic light emitting displaydevice, a plasma display device, or a projected display image. However,this list of display types is for illustrative purposes only and is notintended to be limiting in any way.

There are many ways of accomplishing this end. There are endlessvariations of placement of parts, methods of generating image patterns,different ordering of parts, and/or display images which accomplish thesame objective. Someone practiced in the art will be able to design andconstruct many variations, which include but are not limited to thoseabove. Hence the invention is what is in the claims and includes morethan the embodiments described below.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating prior art in which the 3Dstereoscopic images virtual location moves as viewpoint shifts.

FIG. 2 is a schematic diagram illustrating prior art in which the 3Dvirtual image is unable to be viewed stereoscopically when the viewer'shead is angularly tilted in relation to the display.

FIG. 3 is a schematic diagram illustrating prior art 3D autostereoscopic displays, which limit viewing location.

FIG. 4 is a schematic diagram illustrating an embodiment where the 3Dstereoscopic image remains fixed in space as viewing location isshifted.

FIG. 5 is a schematic diagram illustrating an embodiment where the 3Dstereoscopic image remains fixed and viewable as the viewer's head isangularly tilted in relation to the display.

FIG. 6 is a schematic diagram illustrating an embodiment where the 3Dstereoscopic image remains fixed in space as the viewing location ismoved closer or farther from the display.

FIG. 7 is a schematic diagram illustrating an embodiment where the 3Dvirtual object is seen from different viewpoints yet remains fixed inspace.

FIG. 8 is a schematic diagram illustrating an embodiment applyingviewpoint sensors.

FIG. 8A is a schematic diagram illustrating an embodiment wheredisplayed images may be changed as time progresses.

FIG. 9 is a schematic diagram illustrating an embodiment applyingviewpoint sensors and either anaglyph glasses or passively polarizedglasses.

FIG. 9A is a schematic diagram illustrating an embodiment applyingviewpoint sensors and passively polarized anaglyph glasses.

FIG. 10 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating user interaction with the virtualimage.

FIG. 11 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating user interaction with the virtualimage.

FIG. 12 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating user interaction with the virtualimage.

FIG. 13 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating user interaction with the virtualimage.

FIG. 14 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating user interaction with the virtualimage.

FIG. 15 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating a virtual cave.

FIG. 16 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating a virtual simulator.

FIG. 17 is a schematic diagram illustrating an embodiment applyingposition sensors and illustrating a virtual gaming system.

FIG. 18 is a schematic diagram illustrating an embodiment viewable inportrait or landscape modes.

FIG. 19 is a schematic diagram illustrating an embodiment of anaglyphglasses.

FIG. 20 is a schematic diagram illustrating an embodiment of passivelypolarized glasses.

FIG. 21 is a schematic diagram illustrating an embodiment of passivelypolarized anaglyph glasses.

DETAILED DESCRIPTION OF THE INVENTION

With reference now to FIG. 1 of the drawings, there is shown anillustration of prior art. A 3D stereoscopic image is presented toviewers positioned at A and B. The left or first image (item 160) aswell as the right or second image (item 170) locations is fixed on theimage display (item 114) for either viewing from position A or B. Theresult is 3D image object locations, 180 and 182, which differ in space.Each stereoscopic image tends to be more in front of the viewingposition.

With reference now to FIG. 2 of the drawings, there is shown anillustration of prior art. It is apparent that changing viewing angleresults in less than optimal 3D image or possibly failure of 3D imaging.

With reference now to FIG. 3 of the drawings, there is shown anillustration of prior art, a 3D stereoscopic device that employs currentlouvers to aim or guide the light from an image to the viewer's eyes.The limitation is because the louvers are fixed and not configurablebased on viewing location. Therefore the viewing location is limited.

With reference now to FIG. 4 of the drawings, there is shown anillustration of an embodiment of the instant invention. Sensors (item116) locate the viewpoint perspectives. These sensors may be passivereceivers, or may be emissive and receptive of signals, or of othermethods to determine viewpoint locations. Based on where the viewpointperspective is sensed, an image is created corresponding to how theintended image would be seen from that viewpoint. This is an improvementover prior art where viewpoint location was approximately fixed in spacefor best viewing. The instant art takes viewpoint into considerationwhen presenting images.

For a viewer located at A, the first or left displayed image (item 160)is now a function of the position of the left or first eye of viewerperspective A. The second or right displayed image (item 170) is now afunction of the position of the right or second eye of viewerperspective A. For a viewer located at B, the first or left displayedimage (item 162) is now a function of the position of the left or firsteye of viewer perspective B. The second or right displayed image (item172) is also now a function of the right or second eye of viewerperspective B. As a result, the 3D stereoscopic object image (item 190)is now seen in approximately the same location in space from bothviewpoints A and B.

Due to the 3D stereoscopic images location being approximately fixed inspace its position in relation to the display may be determined. Thismay then be compared with the sensed location of a viewer's body part,wearable object, or pointer. In this manner it will be possible for oneor more users to interact with the 3D stereographic objects or images.

With reference now to FIG. 5 of the drawings, there is shown anillustration of an embodiment of the instant invention. Sensors ormarkers (item 116) locate the viewpoint perspectives. These sensors maybe passive receivers, or may be emissive and receptive of signals, or ofother methods to determine viewpoint locations. Facial or objectrecognition may be used in lieu of sensors or markers to determineviewpoint locations. Other position sensing technologies that employmagnetism, accelerometers, or gravitation sensing may be employed toimprove tracking of objects with the intent of improvement of speed andaccuracy. Based on where the viewpoint perspective is sensed, an imageis created corresponding to how the intended image would be seen fromthat viewpoint.

For a viewer located at A, the first or left displayed image (item 160)is a function of the position of the left eye of viewer A. The second orright displayed image (item 170) is a function of the position of theright eye of viewer A.

In this illustration, the viewer located at B has his head tilted inrelation to the display (item 114). For the viewer located at B, thefirst or left displayed image (item 162) is a function of the positionof the left eye of viewer located at B. The second or right displayedimage (item 172) is a function of the position of the right eye ofviewer located at B. As a result, the 3D stereoscopic object image (item190) is now seen in approximately the same location in space from bothviewpoints A and B. The viewer located at B is able to see the 3Dstereoscopic image in approximately the same location in space as whenthe viewer is located at A, even though his head is tilted with respectto the display.

The 3D stereographic images location remains approximately fixed inspace. This allows it's fixed position coordinates to be determined.These may then be compared with the sensed location of a viewer's bodypart, wearable object or pointer. In this manner it becomes possible forone or more users to interact with the 3D stereographic objects orimages. Other position sensing or tracking technologies such asmagnetic, accelerometers, inertial, or gravitation sensing may beemployed with the intent of improvement of speed and accuracy.

With reference now to FIG. 6 of the drawings, there is shown anillustration of an embodiment of the instant invention. This illustratesthe fact that in addition to viewing angle, the viewing distance also ismeasured in order to create the correct display image presentations(items 260 and 270). In this manner both viewpoint 1 (item 220) and 2(item 222) are able to see the virtual object image (item 292) inapproximately the same location in space. Sensors (item 116) locate theviewpoint perspectives. These sensors may be passive receivers, or maybe emissive and receptive of signals, or of other methods including butnot limited to facial or object recognition to determine viewpointlocations. Based on where the viewpoint perspective is sensed, an imageis created corresponding to how the intended image would be seen fromthat viewpoint.

With reference now to FIG. 7 of the drawings, there is shown anillustration of an embodiment of the how an object might appear whenviewed from different perspectives within the instant invention.

With reference now to FIG. 8 of the drawings, there is shown anillustration of an embodiment of the instant invention applying eitheranaglyph, passively polarized glasses or passively polarized anaglyphglasses. One or more sets of sensors (item 116) may be used to sense thelocation of glasses (items 108 and 120) and specifically the lenses(items 109, 110, 122, and 124) of the glasses using position markers(items 112 and 113) located on the glasses.

These markers may emit or reflect light or sound, or may be of themagnetic variety. Alternatively, object or facial recognition technologymay be used to sense the position of the lenses. When anaglyph glassesare employed, these object images would be color coordinated withcorrect optical association to the anaglyph glasses so a 3D image isseen. When passively polarized glasses are employed, these object imageswould be polarization coordinated with correct optical association tothe passively polarized glasses so a 3D image is seen.

By the aforementioned means, an object image (item 128), in this case acylinder would be presented as different images to perspective viewinglocations represented by items 108 and 120. More specifically, each lensof the glasses would pass a unique perspective image to the intendedeye. Images passing through lenses 109, 110, 122 and 124 are createdbased on viewpoint perspective as viewing location differs.

With reference now to FIG. 8A of the drawings, there is shown anillustration of an embodiment of the instant invention. Thisillustration shows progression through time. Item 200 shows how asviewing location is changed; the 3D stereoscopic images location remainsunchanged in space. Item 240 shows how this is accomplished by enablingeach prospective viewpoint to see an image created based on theviewpoints perspective as viewing location differs.

With reference now to FIGS. 9 and 9A of the drawings, a flow diagram ofan embodiment the instant invention is presented which shows two methodsfor creating 3D stereoscopic images which are seen from differentperspectives while the 3D stereoscopic object is seen in the samelocation in space. A first method (A) employs anaglyph glasses. A secondmethod (B) employs passively polarized glasses. A third method (C)employs passively polarized anaglyph glasses. However this is notintended to limit the device to these methods, and any method thatproduces the same results may be used.

One means to accomplish this is for the sensors to track an object, usefacial recognition. Magnetic, acceleration, and gravitational data mayalso be employed to determine the first and second viewpoints. Theviewpoints correspond to the positions of first or left and second orright eye.

The other methods for locating these viewpoint locations include but arenot limited to markers that may reflect or transmit light and or sound,or create a magnetic field. These markers may be located on the face,body or on a wearable object. The methods given to recognize and locatea pair of eyes, glasses or facial feature viewpoints is for illustrativepurposes only and is not meant to be limiting in any way.

With reference now to FIG. 10 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a keyboard is shown. The virtualimage of the keyboard in space is approximately the same for mostviewing locations. Therefore, the virtual location in space of eachindividual key on the keyboard may be calculated. In this manner a flatimage may be projected in the 3D stereoscopic real world to create avirtual touch screen. This virtual display may be interacted with basedon proximity sensing in much the same way a 2D touch screen would.Additional visual or aural enhancements would allow the user to knowwhen his proximity triggers a response. For example a ripple pattern asis often seen on the surface of the water would alert the user his touchis in proximity to a location on the 3D stereoscopic image. In thisembodiment, either the method applying anaglyph glasses, passivelypolarized glasses, or passively polarized anaglyph glasses may be used.

In addition, we may use tracking methods to locate a pointer, body part,or wearable device. Their position in space may likewise be calculatedor quantified. A wearable device such as a glove may contain positionmarkers of reflective or emissive materials which enable sensors toaccurately determine it's location in space and for the case of a glovealso the fingers. Advanced sensors may be able to detect the location offingers without the need for gloves with position markers. In thisembodiment, the methods applying anaglyph glasses, passively polarizedglasses or passively polarized anaglyph glasses may be used.

As the location of the 3D stereoscopic keyboard and also a pointer orpointers location is known, it may now be possible through computationto determine when the body part or pointer is in proximity to places onthe keyboard. In this manner keyboard entries may be made. This issimilar to what occurs on a 2D screen with touch sensing. The differencebeing the typing takes place on a virtual image as opposed to a solidsurface. Most methods of interacting with a 2D touch screen may beapplied to the 3D virtual image. The user does not have to be withinreaching distance of the 2D display in order to interact with thestereoscopic virtual image. In this embodiment, either the methodapplying anaglyph glasses, or the method applying passively polarizedglasses may be used. The method applying passively polarized anaglyphglasses may also be used.

The virtual keyboard and any other virtual object may be interacted in amultitude of other ways. These include stretching and shrinking,twisting and turning and any other ways a 2D touch object could bemanipulated. These descriptions of 3D object image manipulations areillustrative only and are not intended to be limiting in any way. Theunderstanding is that for the 3D virtual touch object, 3 axis ratherthan 2 axis, may be applied and manipulated. In this embodiment, eitherthe method applying anaglyph glasses, or the method applying passivelypolarized glasses may be used. The method applying passively polarizedanaglyph glasses may also be used.

In addition, the virtual keyboard or any other virtual interactivedevice described below may be brought forth and/or removed by usergestures sensed by the systems location sensors. In addition gesturessensed by the location sensors may be used for other functions, such asbut not limited to turning the pages of an electronic book, changingstations on a television, or raising or lowering volume of the displaysystem or other components. The interactive control devices may bebrought forth by gesture, voice commands, a combination of the two or byother means.

With reference now to FIG. 11 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a remote controller is shown. Inaddition, the remote controller may be applied to control objectsoutside the device. This may be accomplished by applying wifi, Bluetoothor other wireless means. In addition by applying the internet items at alarge distance from the display may be controlled. In this embodiment,either the method applying anaglyph glasses, or the method applyingpassively polarized glasses may be used. The method applying passivelypolarized anaglyph glasses may also be used. All of the propertiesdescribed in association with illustration 10 may apply.

With reference now to FIG. 12 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a keyboard is shown. Placing,touching, pressing, or otherwise gesturing at the keyboard may through acomputer interface produce sound or music. The virtual keyboard shown isfor illustrative purposes and is not intended to be limiting. Othervirtual musical instruments include, but are not limited to drums,percussion instruments, wind wood instruments, etc. In this embodiment,either the method applying anaglyph glasses, or the method applyingpassively polarized glasses may be used. The method applying passivelypolarized anaglyph glasses may also be used. All of the propertiesdescribed in association illustration 10 may apply.

With reference now to FIG. 13 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a pottery wheel is shown. Such avirtual image may be made to rotate and a virtual pottery creation maybe created. The image may be manipulated by the user and saved for 3Dprinting or other uses. In like manner other objects may be createdwhich do not require a rotational motion. In this embodiment, either themethod applying anaglyph glasses, or the method applying passivelypolarized glasses may be used. The method applying passively polarizedanaglyph glasses may also be used. All of the properties described inassociation with illustration 10 may apply.

With reference now to FIG. 14 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a box is shown. The box ismanipulated by use of a pointing tool (item 700). This pointing tool mayhave a tip (item 704) of emissive material, reflective material or othermeans to make it's location easily read by the sensors. The pointer mayalso have one or more functional buttons (item 702). These buttons mayoperate in a similar fashion as buttons on a computer controller such asa mouse. By applying this pointer an object may be identified, grabbedand moved, sized or any number of functions commonly associated with thecomputer mouse. The difference being that the virtual objects and thepointer may be operated in 3 axis or dimensions. In this embodiment,either the method applying anaglyph glasses, or the method applyingpassively polarized glasses may be used. The method applying passivelypolarized anaglyph glasses may also be used. All of the propertiesdescribed in association with illustration 10 may apply.

With reference now to FIG. 15 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic virtual cave is shown which employs thetechnology previously illustrated. In such a cave the objects appearmore real as they remain approximately fixed in space as the viewer andviewpoint location are changed. The objects in the virtual cave may beinteracted with in the manner which has been described above. In thisembodiment, either the method applying anaglyph glasses, or the methodapplying passively polarized glasses may be used. The method applyingpassively polarized anaglyph glasses may also be used. All of theproperties described in association with illustration 10 may apply.

With reference now to FIG. 16 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of an aircraft simulator is shown.Varying amounts of the simulator may be simulated depending on the wantsof the user. It may be that only objects outside of the controlenvironment are simulated. However it is possible for virtual controls,buttons, switches and other controlling devices to be simulated andinteracted with, in the manner described above. In addition the interiorenvironment of the simulator may be created virtually. This enablessimulators whose configuration may be controlled by applying computersoftware. For example a virtual flight simulator could be used as aBoeing 737 for one event and reconfigured as an Airbus 320 for the nextevent. This would save money for the user as fewer simulators would beneeded. Other virtual simulations lend application to, but are notlimited to, law enforcement and the military. In this embodiment, eitherthe method applying anaglyph glasses, or the method applying passivelypolarized glasses may be used. The method applying passively polarizedanaglyph glasses may also be used. All of the properties described inassociation with illustration 10 may apply.

With reference now to FIG. 17 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration a 3D stereoscopic image of a game (item 196) is shown. The3D virtual game pieces may be created and also manipulated by any of themethods previously described. All of the properties described inillustration 29 apply. The display system (item 114) may be made to layflat so as to provide a better gaming surface. In this way board gamesand other types of games may be played and interacted with by the useror users. Virtual worlds may be created, viewed and/or interacted with.This embodiment of the instant invention makes an excellent gamingsystem. In this embodiment, either the method applying anaglyph glasses,or the method applying passively polarized glasses may be used. Themethod applying passively polarized anaglyph glasses may also be used.The method of passively polarized anaglyph glasses is of good use forgames such as scrabble or poker, where one player hides information fromthe other. All of the properties described in association withillustration 10 may apply.

Using passively polarized anaglyph glasses would allow two viewers toview real world 3D stereoscopic images that differ in content. Thecontent could be individualized in such a manner so a player may view areal world stereoscopic image that the other player could not view. Thiswould be especially useful in gaming simulations, but is not intended tobe limited to this use. For example it could also be useful in twoperson simulators where each viewer would have a different perspective.

With reference now to FIG. 18 of the drawings, there is shown anillustration of an embodiment of the instant invention. In thisillustration, a handheld device is shown which may be used in bothportrait and landscape modes. The method of anaglyph glasses orpassively polarized glasses may be applied. The method applyingpassively polarized anaglyph glasses may also be used.

With reference now to FIG. 19 of the drawings, there is shown anillustration of anaglyph glasses. A first lens (item 204) allows lightof a different color to pass than that of a second lens (item 206).

With reference now to FIG. 20 of the drawings, there is shown anillustration of passively polarized glasses. A first lens (item 304)allows light of an opposing polarization direction to pass than that ofa second lens (item 306). The polarization may be linear, circular, orelliptical.

With reference now to FIG. 21 of the drawings, there is shown anillustration of passively polarized anaglyph glasses. In illustration Athe planes of polarization in is the same for both lenses of a pair ofglasses, while the color of the lenses is different. Between glasses 802and 812 the polarization orientation is different. The polarization maybe linear, circular, or elliptical. In illustration B the polarizationpattern is in opposition between lenses of the same pair of glasses. Thecolor in the first and second lens of the glasses is the same. Howeverthe colors of one pair of glasses (item 852) differs from the colors ofthe second pair of glasses (item 862). These would allow two users tointeract with different images. Examples would be a game of scrabble orpoker. However these examples are not intended to limit the use of thisdevice in any way.

Furthermore, the instant invention may be switched to other modes ofoperation. These include but are not limited to prior art 3Dstereoscopic imaging where the 3D stereoscopic image location varieswith viewer location. This may be a useful mode for viewing prior arttechnology 3D imagery such as 3D movies. Also, the display may be usedto view 2D images in the manner of prior art. The switching among thevarious 3D and 2D modes may be automatic based on the format of theviewing material.

Furthermore, although exemplary embodiments have been disclosed herein,and although specific terms are employed, they are used and are to beinterpreted in a generic and descriptive sense only, and not for purposeof limitation. Accordingly, it will be understood by those of ordinaryskill in the art that various changes in form and details may be madewithout departing from the spirit and scope of the instant invention asset forth in the claims.

By way of conclusion, the prior art in this area of technology islimited by viewing location. In addition the prior art is limited to 3Dstereoscopic images that may not be seen in approximately the samelocation as viewpoint changes nor when viewed by different users. Thisdoes not allow users to communicate about a 3D stereoscopic image bygestures, for example pointing, or gesturing. In the instant inventionthe user(s) may also interact with 3D stereoscopic images or virtualimages. Applying location-sensing technology and comparing position datawith the computed 3D virtual object location accomplish this.

In addition, a 3D stereoscopic image may be created which remainsapproximately fixed in space. One or more viewers may point at such avirtual image. Because the virtual image is nearly fixed in space it'svirtual location may be compared with a user's finger, other body partsor pointer. In this way a viewer may interact with a virtual 3D image bypointing or other gestures as sensed by the position sensors. Inaddition the position sensors may be used to interpret a variety ofgestures that correspond to a variety of commands. By using the positionsensors gestures may be made which cause the display device to react tothe viewer. Examples include but are not limited to gestures that callfor a virtual keyboard or remote to be displayed. They may also cause astation of a television to change or the volume to increase or decrease.They may be used to control other devices as well via wired or wirelessmeans. There are many more possibilities and this list of gestures andresults is not intended to be limiting in any way.

These and other advantages are readily apparent to one who has viewedthe accompanying figures and read the descriptions.

Exemplary embodiments have been disclosed herein, and although specificterms are employed, they are used and are to be interpreted in a genericand descriptive sense only and not for purpose of limitation.Accordingly, it will be understood by those of ordinary skill in the artthat various changes in form and details may be made without departingfrom the spirit and scope of the instant invention as set forth in thefollowing claims.

While the foregoing written description of the invention enables one ofordinary skill to make and use what is considered presently to be thebest mode thereof, it should be understood that various changes,substitutions and alterations can be made herein without departing fromthe spirit and scope of the invention as defined by the appended claims.Therefore, the invention is not to be limited by the above describedembodiment, method, and examples, but by all embodiments and methodswithin the scope and spirit of the invention as claimed.

The invention claimed is:
 1. A stereoscopic image display devicecomprising: at least one sensor configured to track positions of twopairs of eyewear based on perspective locations of lenses of the twopairs of eyewear to a physical object in relation to the stereoscopicimage display device, wherein the two pairs of eyewear are physicalobjects that are each associated with a user of two users; a processorconfigured to map coordinates of a three-dimensional (3D) virtual objectgenerated by the stereoscopic image display device, wherein the 3Dvirtual object comprises a location observable by the lenses in theeyewear relative to the physical object; and, an image generatorconfigured to create two respective pairs of first and secondstereoscopic images of the 3D virtual object displayed to respectiveeyes of the two users of the stereoscopic image display device at thelocation, wherein the first and second stereoscopic images for each userare based upon viewpoint perspectives of an angle and distance of theperspective locations of the lenses of the 3D virtual object to eachuser, and wherein the 3D virtual object is positioned at a same locationin a physical space for each user based on said viewpoint perspectives.2. A stereoscopic image display device comprising: at least one sensorconfigured to track positions of eyes of viewers of the stereoscopicimage display device, based on object recognition, in relation to thestereoscopic image display device; a processor configured to mapcoordinates of a three-dimensional (3D) virtual object generated by thestereoscopic image display device, wherein the 3D virtual objectcomprises a location in a physical space in front of and relative to thestereoscopic image display device; an image generator configured tocreate respective pairs of first and second stereoscopic images of the3D virtual object displayed to the eyes of each viewer of thestereoscopic image display device such that the 3D virtual object isseen by each viewer in a same physical location, wherein the first andthe second stereoscopic images for each viewer are based upon viewpointperspectives of an angle and distance of a perspective location of theeyes of each viewer as detected by the at least one sensor, and whereinthe 3D virtual object is positioned at a same location in said physicalspace for each viewer based on said viewpoint perspectives; and, lensesof glasses that use both color discriminating filters and polarizationdiscriminating filters, wherein the first and second stereoscopic imagesare directed to left and right eyes respectively of each viewer; whereinthe 3D virtual object is viewable by a plurality of viewers, as shown bythe respective first and the second stereoscopic images created for eachrespective viewer.
 3. The system of claim 2 wherein the at least onesensor is further configured to apply one or more of object recognition,facial recognition technology, gyroscopic, acceleration sensing,gravitational sensing and magnetic fields to track objects.
 4. Thesystem of claim 2 wherein the lenses of the glasses are made of a colordiscriminating material which allows light with correct colorcharacteristics to pass with stereo coordination to the eyes of eachviewer.
 5. The system of claim 2 wherein the lenses of the glasses aremade of a polarization discriminating material which allows light withcorrect polarization characteristics to pass with stereo coordination tothe eyes of each viewer.
 6. A stereoscopic image display deviceconfigured to control another external device, the stereoscopic imagedisplay device comprising: at least one sensor configured to trackpositions of eyes of viewers of the stereoscopic image display device,based on object recognition, in relation to the stereoscopic imagedisplay device; a processor configured to map coordinates of athree-dimensional (3D) virtual object generated by the stereoscopicimage display device, wherein the 3D virtual object comprises a locationin a physical space in front of and relative to the stereoscopic imagedisplay device; and, an image generator configured to create respectivepairs of first and second stereoscopic images of the 3D virtual objectdisplayed to the eyes of each viewer of the stereoscopic image displaydevice such that the 3D virtual object is seen by each viewer in a samephysical location, wherein the first and the second stereoscopic imagesfor each viewer are based upon viewpoint perspectives of an angle anddistance of a perspective location of the eyes of each viewer asdetected by the at least one sensor and wherein the 3D virtual object ispositioned at a same location in said physical space for each viewerbased on said viewpoint perspectives.
 7. The system of claim 6 whereinthe at least one sensor is further configured to apply one or more ofobject recognition, facial recognition technology, gyroscopic,acceleration sensing, gravitational sensing and magnetic fields to trackobjects.